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(54) Data transmission in non-reliable networks 

(57) The present invention relates to a method and 
apparatus for transmitting video and/or audio data in a 
non-reliable and bandlimited network from a server to a 
client. The network may for instance be a wireless net- 
work. The data stream includes P-frames and l-frames 
If dunng transmission a frame gets lost, the client noti- 
fies the server of the data loss when the next packet is 
received at the client correctly. The seiver then skips all 



the P-frames of the current P-frame sequence and con- 
tinues the transmission with the next l-frame. Preferably, 
each packet has assigned a sequence number and the 
message from the client includes the sequence number 
of the cun-ently received packet. The server may ignore 
a message from the client if the ciienrs request for skip- 
ping the P-frames has already been executed. It is pre- 
ferred to make use of the present invention forstreaming 
MPEG data. 
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Description 



100011 The present invention relates to a data trans- 
mission method apparatus and more particularly to vid- 
eo and/or audio streaming in a non-reliable and band- 
limited network such as a wireless network. 
100021 An example of a data stream of multtmedia 
oackets is an MPEG {.Motion Pictures Expert Group) 
stream. The MPEG stream consists of a flow of b.t-pack- 
ets called frames or packets and is streamed from the 
server to the client. The stream usually contains infor- 
mation in different formats and is therefore a mixture of 
independent data, so-called intra-coded frames or I- 
frames. and dependent data, which depends on preced- 
ing data, so-called predictive-coded frames or K- 

roOMl MPEG files which are stored on hard disks. 
CD-ROlvis etc. are played back by MPEG playback de- 
vices which first retrieve Ihe data from the storage de- 
vice decompress and decode the data to audio andvid- 
eo digital signals, and then reproduce the signals on the 
playback device such as a '^o'^P"^^^ ^V^^.^"]; ^"""^ 
playback of a selected MPEG audioA/ideo playback f le. 
many kinds of onors may occur, such as a fauft in the 
memory or storage unit containing the playback file (e. 
rT bad sector in a disk drive or CD-ROM drive) an 
error in a data path, or an error in data transmission due 
to a fault in an output unit of the computer system. In the 
prior art. playback devices have therefore been deve^ 
oped, which involve error recovery mechanisnis. US 
s 784 527 discloses such error handling in an MPEQ 
piaybacksystem. If an error occurs, one of the disclosed 
recovery processes includes skipping unimportant 
frames until an l-frame is reached. 
r00041 A completely different problem as compared 
with the error recovery in an MPEG P'^yback SV***"; 
the data transmission in non-reliable and bandlimited 
networks. Typical examples of such nehworks are wire- 
less networks which are inherently non-reliable since 
the wireless channels used for data transmission are er- 
ror-prone, have limited bandwidth, and addihonally the 
transmitted data is delayed or might even get lost due 
to network congestion. This is a severe problem in par- 
ticular in real-time streaming of MPEG files. 
roOOSl FIG. 1 illustrates a conventional video stream- 
ing system. Video sewer 110 transmits video daU 
through the non-reliable channel 1 50 to video client 1 60. 
For this purpose, the video server 110 includes a trans- 
mitter buffer unit 130 which receives data frames from 
video source application 120. In the transmitter butter 
unit 130. the frames are then transmitted under control 
of channel access controller 140. In the video client 1 60 
the data are received in a receiver butter unit 1 70 which 
reassembles the frames from the segments. The video 
frames are then sent to video display application 180 
which might for example likewise be a storage device, 
or the like. 

[0006] The problems with the prior art systems when 



transmrtting video or MPEG data via a non-reliable 
chanTeulo will now be described in more detail wrth 
reference to FIG. 2. In this example. ^»^« ";;:'«'i,^"J'"J^^ 
a sequence of l-frames and P-frames to the Cef^L For 
5 exDianatory reasons, each frame is given a frame 
number tSi) indicating its position in the MPEGstream. 
roOOTl The sen/er first transmits an l-frame. whch is 
correctly delivered to the client after expiration of a cer- 
tain time delay. The second frame tea P-'r^«^«^«^ 
fo is dependent on the l-frame. The P-frame s also cor- 
rectly transmitted to the client. 

[00081 The third frame is again a P-frame. whK:h « . 
therefore dependent on both the l-frame and the first P- 
fT^e in the'example of FIG. 2. P-frame FN=3 cannot 
.5 be received at the client, e.g. because of a network con- 
gestion. The following frames nevertheless Pass chan- 
nel 150 with no error. Consequently, even though the 
senrer has transmitted all the frames, the client did re- 
ceive frames FIM=1 . 2. 4-9. but not FN=3. 
20 [00091 Since however P-frame FN=4 IS dependent on 
P-frame FN=3. and the same is tme for all the following 
P-frames up to the next l-frame, the client cannot use 
the P-frames although he has received them. This pnor 
art system therefore is highly inefficient in its usage of 
2S network resources since a number of frames has been 
sent but can not be used. Ha 
[00101 Another approach of streaming multimedia da- 
!a through non-reliable channels involve the retransm^ 

sion of packets. While this approach improves me QoS 
30 under bad channel conditions, it increases the required 
bandwidth in the network as well as the transm«s«n 
delay, it is therefore not suitable for real-t.rne multimeda 
streaming of data in networks having '""ited bandw.cfth 
and high error probability. Under such conditions, many 
35 retransmission attempts are required and the real-tome 
requirements can no longer be fulfilled, 
rooill It is therefore the object of the invention to pro- 
tide a method and apparatus for transmitting data in a 
non-reliable and bandlimited network, making efficient 
4Q use of the limited bandwidth in case of data loss. 

[00121 This object is solved according to the invention 
as defined in the independent claims. 
[00131 According to the invention, the client notifies 
he server in case of packet loss. Thus, "le Present 
*s vention provides a feedback from the cherrt to the 
streaming senrer. which allows the server to sWp aH the 
packets Which depend on the lost ^-.^'^-"^h^IZ 
advantageous in that it saves bandwidth which can now 
be spent on other uses in the network or which can be 
50 used for increasing the throughput of that data stream 
in which the packet loss has occurred. 
r0014] The present invention further is advantageous 

n that it adopts techniques in a ^^^^^^''^''^^X 
viously known in the field of playback systems only 
55 thereby providing a feedback interaction with the remote 

[0°0151 ' Preferred embodiments of the present inven- 
tion are defined in the dependent claims. 
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[00161 Ass.gnirg a sequence number to each packer 
leads advantageously to improved frame control capa 
b...t,es. Further. Incorporating the sequence number of 

Tjnl'T"" "on-acknow.edgement com- 

mand allows the server to take into account any signal 
delay ,n the network. This Increases the rellabili J of the 
streaming system. ' 

[0017] Preferred embodiments of the present inven- 
to the accompanying drawings in which: 



FIG. 1 ,s a prior art video streaming system. 

.'^ ^ -pessage sequence chart illustrating the 
cperation of the video streaming system of FIG 1 ■ 
FIG 3 IS a video streaming system according to a 
prefen^ed embodiment of the oresent inv^ntinn- 
FIG. 4 IS a message sequence chart for illustrating 
theoperatlpn of the video streaming system accord- 
ing to the present invention; 
FIG. 5 is a flow chart illustrating the process of send- 
ing a video stream according to a preferred embod- 
iment of the present invention; and 
FIG. 6 is a flow chart illustrating the process of re- 
ceiving a video stream according to the preferred 
embodiment. 



svst^ . Z ^ '° "^"^ ^' ^''^^^ streaming 
system according to the preferred embodiment of the 
present invention Includes a video server 11 0 and a vid- 

ch°anrj;V/n°^''*''K"'"'"""''°^'* '^"^ non-reliable 
channel lSO. The channel of the present embodiment 
IS a wireless Channel. Contrary to the video streaming 
system of FIG. 1. the video client 160 comprises a loss 
detection unit 240 for detecting that a frame is missing 

The video clientieo further includesatransmitterbuffJr 
unit being controlled by channel access controller 260 
for transmitting from loss detection unit 240 a non-ac- 
knowledgement (MACK) packet to the video server 1 10 

ZTV' ''f '^«'^'"9 NACK packet 

from video client 160. video server 110 comprises a rt 

IZV« oT"^° t° transmission 

controller 210. which is connected to transmitter buffed 

S J*".?. °' tf'e Video streaming system 

of FIG. 3 Will now be described in more detail with reT 
erence to FIG. 4. FIG. 4 shows a message sequence 
chart according to the present Invention. Initially, an I- 
frameissentfromtheservertotheclientlntheexample 
T' « g^e" 'he sequence 

number SN.^ and the client is capable of reading this 
information. The l-frame is received properly at the client 
and may therefore bo used for displaying purposes 
[0020] The second frame transmitted by the server is 
a P-frame. which is therefore dependent on the preced- 
ing Wrame. The P-frame has been given the sequence 
ni^mber SN=1 and is likewise correctly received at the 

[0021] The following P-frame has the 
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numtjer SN=2 and is lost during transmission. That is 
the client cannot receive this P-frame. 
[0022] In the example of FIG. 4 and in accordance 
with the example of FIG. 2. the fourth frame. wh4^ 
again a P-frame. is then transmitted from the server and 
•s correctly received at the client. The client, in evaluat- 
ing the sequence number, becomes aware that the pre- 
ceding P-frame having the sequence number SN=2 is 
missing. The client then generates a NACK command 
mcludingthe sequence number of thecurrently received 
packet SN=3 and sends this NACK packet back to the 
ron'^r "°**y'"9 sefver of the packet loss. 
[0023] As can be seen from FIG. 4. due to the trans- 
mission delay of the connection, the NACK packet is re- 
ceived at the server later than the transmission time of 
u.e next ,-frame having SN=4. This P-frame is therefore 
transmitted by the server In the usual manner 
[0024] When the client receives the P-frame SN=4 it 
again evaluates the sequence number and generates 
and sends back a NACK packet including the sequence 
number SN=4. Sending this second NACK packet not 
only is suitable for compensating for transmission de- 
lays but also takes into account that in non-reliable net- 
works, oven tho first NACK packet may be destroyed 
due to e.g. nehwork congestion. 

J*'® •'«»'^'"3 *e f ret NACK packet is 

notified that a frame has not been received at the client 
Since the client cannot make use of subsequent P- 
frames. the server skips these frames and continues 
transmission at the next l-frame. Tliis frame whferfi is 
then given the sequence number SN=5 corresponds to 
the -frame which had in FIG. 2 for explanatory reasons 
the frame number FN=8. 

[0026] Upon receiving the second NACK packet the 
t?7fK ^ evaluating the sequence nur^ber 

that this command is already executed by skipping the 
P-frames FN=e and 7. The server therefore ignores the 

fh!fr » o'^^'^ P^'"'^' ^""^ continues with transmitting 
the next P-frame FN=10 instead of again skipping all P- 
frames up to the next l-frame. a«««»- 
[0027] The process of sending a video stream will now 
be explained with reference to FIG. 5. 
[0028] In step S510. transmission controller 210 of 
video sen/er 11 o receives a frame from video source ap- 
plication 120. and assigns a sequence number to this 
frame in step S520. The sequence number may for in- 
stance be added to meta information included in the 
frame header, but it may be appreciated by those of or- 
dinary skill in the art that any other kind of adding the 
sequence number to a packet may likewise be applica- 

" detemiined in step S530 whether a 

NACK packet has been received from the video client 
If this IS not the case, the frame is sent in step S570 to 

^"^ '""^ P~"^« ^««"^ns to 
step S51 0 for receiving the next frame from video source 
application 120. 

10030] If, however, in step S530 a NACK command 
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6 



has been received at receiver buffer unit 230. the trans- 
Lsion controller 21 0 detenriines in step S540 whether 
the NACK command has already been • '^^^^^^^ 

NACK command has already been executed^ the cur- 
rent frame is sent in step SS70 to the transm.tter buffer 
1 30 and the process returns to step SS1 0. 
00311 In case the NACK packet is the first one which 
has been received in the current P-frame sequence^the 
v^deo ser/er 1 1 0 detemiines in step S540 that the NACK 
command should not be ignored, and the processing 
cSues with step S550. In this step, the transm.ss.on 
controller 21 0 waits for the reception of the next 1-frame 
from video source applteation 1 20. thereby skipping the 
remaining P-frames of the current P-frame sequence^ 
The rUefved l-f rame is then assigned a SN in step S560 
and transmitted in step S570 before the process returns 
fo step S51 0 for continuing transmission of the following 

raoaS^^Referring now lo FIG. 6. the P'O^^ss of receiv- 
Ina a video sUeam at video client 1 60 is descnbed. After 
r^eh/ing a frame in step S610. the sequence number 
of the frame is revealed and evaluated in step S620. If 
upon evaluating the sequence number it « determmed 
that one of the preceding frames is missing (step S630) 
ooeration of the loss detection unit 240 passes control 
to step S640. If it detemiined in step S640 that the cur- 
rently received data frame is an l-frame. the process 
sends in step S660 the frame lo video display applica- 
tion 1 80 and retums to step S61 0 since there is no need 
to inf omi the video server of the data frame loss. Other- 
wise the loss detection unit 240 generates an NACK 
Dack'et in step S670 including the sequence number re- 
Sea^ed in step S620. The generated NACK packet is 
then transmitted in step S680 by transmitter buff er un J 
250 under control of channel access controller 260 
through the channel 150 back to the video server 110. 
r00331 If it is detemnined in step S630 that no frarne 
\s missing, the video client 160 adds the frame to the 
strTL and fon«ards in step S640 the frame to video 
display application 180. The process of FIG. 6 then re- 
turns to step S610 for receiving the next video frame 
from video server 110. 

r00341 While the pref eaed embodiment of the present 
fnvention has been described in thecontext of streaming 
video data, it will be appreciated by those of ordinanr 
skill In the art that another prefenred embodiment may 
alternatively or addilionally focus on ''^^^'"S 
data. Preferably, the data stream is an MPEG data 

r0035] ' Further, the present invention has been de- 
scribed as preferably operating in a wireless network^ 
Wireless networks include any kind of networks in which 
data is transmitted through space by electromagnetic 
waves including radio communication and cordless 
transmissions. The invention may however likewise be 
applied to data transmission over any other kind of non- 
reliable channels. 



Claims 

1 Method for transmitting video and/or audio data in 
a non-rellable network from a server (1 1 C) to a client 
5 (160). said data being arranged in data frames 
fomiing a data stream, said data frames .nclud mg 
P-frames and l-frames. the method composing the 
steps of: 



10 



15 



20 



receiving (SS30) at the sen/er a message 
(NACK) indicating that a data frame is missing, 
said message being sent from the client over 
the non-reliable network; and 

continuing (S550-SS70) the transmission of the 
data stream with the next l-frame. thereby skip- 
ping the P-frames up to said l-frame. 

The method according to claim 1. further compris- 
ing the steps of assigning a sequence number (SN) 
to each data frame. 

3. The method according toclaim 2. wherein said mes- 
sage from the client contains the sequence number 

25 of the last data frame which has been properly re- 
ceived at the client. 

4. The method acco^iing to one of y° f j"'" 
ther comprising the step of ignonng (^0) «^ 
message from the client if the server has already 
received a corresponding previous message from 
the client relating tc. the same data frame loss. 

5 The method according to one of daims 1 to 4. 
wherein the data frames are MPEG frames. 

6. The method according to one of ^^lai-ns ^ 5. 
wherein said non-rellable network is a wireless net- 
work. 

7 Apparatus for transmitting video and/audio data in 
anon-reliablenetworictoaremotecllent(160).sad 

data being arranged in data frames forniing a data 
stream, said data frames including P-frames and I- 
43 frames, the apparatus comprising: 

means (230) for receiving (SS30) from the client 
a message(NACK) indicating that a data frarne 
is missing, said message being sent from the 
so client over the non-reliable networtt; and 

a controller (210) for continuing (SSS0-S570) 
the transmission of the data stream wrth the 
next l-frame. thereby skipping the P-frames up 
55 to said l-frame. 

8 The apparatus according to claim 7, being arranged 
for perfoaning tiie method according to one of 
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claims 1 to 6. 
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